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TITLE OF THE INVENTION 

Information Selection Apparatus Selecting Desired Information 
from Plurality of Audio Information by Mainly Using Audio 
BACKGROUND OF THE INVENTION 
5 Field of the Invention 

The present invention relates to an information selection method 
selecting information associated with an audio information source, and an 
information selection apparatus employing such an audio information 
selection method. 

10 Description of the Background Art 

As a conventional technique of the method of selecting one 
information from a plurality of information, a retrieval engine using 
character information provided on a display is known. However, the task 
of continuously viewing the screen will be a burden on the user side. 

15 Accordingly, attention is now focused on the usage of voice and sound. In 
the case where a great number of audio media such as radio programs, 
music CDs and the like are the subject of selection, it will be easier for the 
user to actually listen to the contents rather than by selection using only 
character information. 

20 A method of selecting information associated with a sound source 

according to a plurality of sound sources is disclosed in, for example, 
Japanese Patent Laying-Open No. 10-124292. According to this method, a 
plurality of sound sources are placed around the user. The audio outputs 
are basically issued at the same volume. The user distinguishes audibly 

25 the audio outputs generated simultaneously and specifies a desired 
direction to select the information associated with the sound of that 
direction. More specifically, various audio messages such as "play", 
"record", "rewind" and "stop" are determined for the front, right, back, and 
left, respectively, as the operation of a video equipment. When the user 

30 wants to effect recording, the right direction is to be selected using a 

pointing device such as a cross pad. Another method disclosed in this 
publication is devised to facilitate the audible feature of each generated 
sound by issuing the sound of each audio output with a slight time difference 
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to define sound quality difference (male voice, female voice). 

A method of playing again information that was missed audibly by 
the user indicating a certain direction with a single sound source rotating 
about the user is disclosed in "Dynamic Soundscape: mapping time to space 
5 for audio browsing" (CHI97) by Minoru Kobayashi and Chris Schmandt 
(MIT). According to this method, one sound source moves around a user 
while issuing audibly various topics at a constant volume and sound quality. 
In the case where the user missed a certain topic by the ear, the user points 
out the area providing the audio output of that topic using a pointing device, 

10 whereby a sound source is generated at that site. Playback is resumed 

from the topic that was audibly issued when passing that site of the sound 
source. In this playback operation, the volume of the former sound source 
is lowered and the sound source that newly provides the audio output effects 
playback at a higher volume. Both sound sources move in an orbit at the 

15 same time. Up to eight sound sources are allowed simultaneously in this 
system. 

However, even if audio output is provided with time difference or 
with different sound quality corresponding to each direction to facilitate 
identification of the position of the sound as in the above-described 

20 publication, the direction that can be distinguished audibly by the human 
being is limited to eight directions at most. The case where there are a 
great number of selection branches cannot be accommodated. Audio output 
of only single words such as playback or recording as in the case of video 
reservation is generally of no problem. However, in the case where audio 

25 output of continuous contents such as a plurality of news programs is issued, 
it is difficult to audibly distinguish the contents even if the sound sources 
are located at less than eight directions. 

In the present specification, "the position of sound" implies the site 
from which sound is audibly output, or a direction from which a sound can 

30 be heard. 

In the above method, only one sound is audibly output unless the 
user provides an input. A plurality of information cannot be obtained at 
the same time. 
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The telephone push phone service is known as an information 
selection interface dedicated to audio (method 1). In selecting information, 
a voice guidance of "Please depress 1 for ... is output. The user depresses 
an appropriate button according to the voice guidance. 
5 Another method is known to operate a system by voice using a 

speech recognition function (method 2). According to this method, a 
predetermined operation command is input through voice, or a natural 
language processing function is added to the speech recognition function to 
operate the system in the manner of ordinary conversation. 

10 A method in which the item to be subjected to selection is altered 

over time is disclosed in Japanese Patent Laying-Open No. 6-149517. 
According to this method, the item to be subjected to selection is altered by 
the user or program request (output at an elapse of a predetermined time). 
A label of that item is displayed on the screen and a tone scale corresponding 

15 to that item is issued from a speaker. The user can select a certain item by 
carrying out a predetermined input operation when the label of the desired 
item appears. 

Method 1 is disadvantageous in that the number of information that 
can be selected or the button to be depressed differs each time depending 

20 upon the contents. The user has to depend upon the voice guidance at 
every select operation, which is time-consuming. Since the number of 
buttons that can be depressed increases, the user will not be able to 
remember the location of each appropriate button. The user will have to 
depress the appropriate button while confirming the location of each button. 

25 This labor is tedious. Particularly in the case where it is dangerous for the 
user to carry out a task with his/her view off, this button position 
confirmation will induce danger. 

Method 2 is disadvantageous in that the user must learn and 
operate a plurality of types of predetermined voice commands, if any is 

30 predetermined. To date, the natural language processing function lacks 
the ability to recognize the meaning of the word input through an audio 
input of high degree of freedom. A technique at the level of practical usage 
is not yet established. 
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According to the technique disclosed in Japanese Patent Laying- 
Open No. 6-149517, a display device is inevitable. The required 
information cannot be provided to the user by just through the audio output. 
Also, the audio information associated with each information corresponds to 
5 only the musical scale of a predetermined tone. It will be difficult for the 
user to master the difference of the tone and the musical interval 
information. 

SUMMARY OF THE INVENTION 

In view of the foregoing, an object of the present invention is to 
10 provide an information selection method including a user-friendly user 
interface employing voice in selecting one desired information out from a 
plurality of information. 

Another object of the present invention is to provide a sound 
information selection apparatus that facilitates selection of desired sound 
15 information from a plurality of sound information. 

A further object of the present invention is to provide a sound 
information selection apparatus that can have the position change of a 
sound controlled by the user's intention. 

Still another object of the present invention is to provide an 
20 information selection apparatus that allows selection of an information 
source without depending upon only visual recognition. 

A still further aspect of the present invention is to provide an 
information selection apparatus that allows the user to identify at one time 
more information retained by an information source. 
25 Yet a further object of the present invention is to provide a sound 

information selection apparatus that allows the presentation status of sound 
information to be easily modified according to the user status. 

Yet another object of the present invention is to provide an 
information selection apparatus including a user-friendly user interface 
30 employing voice in selecting one desired information from a plurality of 
information. 

Yet a still further aspect of the present invention is to provide a 
computer readable recording medium including a user-friendly user 
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interface employing voice in selecting one desired information out from a 
plurality of information. 

According to an aspect of the present invention, a method of 
selecting desired information according to a plurality of sound information 
5 includes the steps of time-controlling independently the position of each 

sound , and selecting a sound. In selecting a sound, information associated 
with the sound is selected. As a result, a sound selection method can be 
provided that allows desired sound information to be easily selected from a 
plurality of sound information. Preferably, the method includes the step of 

10 controlling volume in association with the position of each sound. 
Information can be selected in association with the volume. 

The step of controlling independently the position of each sound 
facilitates distinction between each sound by arranging the position of each 
sound on the circumference of substantially a circle to move in an orbit. 

15 Further preferably, the position change of all the sounds can be set 

earlier than that of the normal time control or returned to the former 
position. As a result, the position change of sound can be controlled by the 
user's intention. 

According to another aspect of the present invention, an information 
20 selection apparatus with a sound source to select desired information 

includes a unit time-controlling independently the position of each sound, a 
sound selection unit selecting a sound, and a selector selecting information 
associated with the sound in response to a selection signal of the sound 
selection unit. 

25 According to a further aspect of the present invention, an 

information selection apparatus with a sound source to select desired 
information source from a plurality of information sources includes means 
for sequentially switching a plurality of information sources as audio 
information and presenting the same by a sound source, means for selecting 

30 audio information relevant to a desired information source from the 
presented audio information. 

By presenting an information source as audio information by voice, 
an information source can be selected without depending upon only visual 
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recognition. By selecting that audio information when presented, an 
information source can be selected by unitary operation. 

Preferably, the information selection apparatus includes means for 
indicating switching of the audio information. 

This allows switching of the audio information by an indication of 
the user. Audio information can be presented at a timing suiting the user's 
wishes. 

Further preferably, the switch specify means specifies presentation 
of audio information presented after or before the currently-presented audio 
information. 

Accordingly, switching can be effected by the user's specification so 
as to present audio information that was to be presented afterwards or that 
is already presented during presentation of audio information. Therefore, 
the user can sequentially refer to information according to his/her wishes. 
This switching is not limited to audio information immediately preceding or 
succeeding the currently-presented audio information. Several audio 
information can be skipped by rewinding or fast-forwarding to present an 
appropriate audio information. 

Further preferably, the information source retains information other 
than the audio information. The information selection apparatus can 
present the other information when the desired audio information is 
selected. 

By presenting information other than the voice information such as 
image information retained by the information source, another information 
of audio information that is not presented can be provided in addition to the 
another information of the currently-presented audio information. Thus, 
the user can identify at one time more information retained by the 
information source. 

The information other than the audio information retained by the 
information source is preferably image information. Information 
depending upon the five senses of the user (the tactual sense, the palate, the 
sense of smell) is allowed as long as it conveys information. For example, 
information can be presented by conducting a current through the clothing 



of the user, the scent, the taste, or the like. 

Further preferably, the information source includes information in 
addition to audio information in the information selection apparatus. This 
additional information is also sequentially switched and displayed according 
5 to switching of the audio information. 

By presenting information other than audio information such as the 
image information retained by the information source during presentation of 
that audio information, the user can identify at one time more information 
retained by the information source. 
10 According to still another aspect of the present invention, an 

information selection method includes the step of gradually narrowing down 
the information from categorized information sources by repeating the 
information selection method. 

By gradually narrowing down the information out from categorized 
15 information sources, the user can easily arrive at the desired information 
out from a large amount of information sources. 

According to a still further aspect of the present invention, a 
recording medium can be applied in which a program is recorded to cause a 
computer to execute the step of sequentially switching a plurality of 
20 information sources as audio information and presenting the selected 
information souce by a sound source, and the step of selecting from the 
presented audio information the audio information relevant to desired 
information source. 

According to yet a further aspect of the present invention, an 
25 information presentation apparatus presenting a plurality of information as 
sound information includes a unit to modify, in presenting sound 
information, the presentation status according to the property of the sound 
information to be presented or the user status. 

Accordingly, the presentation status of sound information can be 
30 easily modified according to the property such as the length, volume, stereo/ 
monaural audio, and sampling frequency of the audio information to be 
presented and the sound quality depending upon the reproduction hardware, 
or according to the user status such as the case where the user is aware or 
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not aware of the information preceding or succeeding the information to be 
presented, or the acceptability of the information applied as sound to the 
user. 

Preferably in the information presentation apparatus, the 
5 presentation status to be modified includes either the status of presenting at 
the same time the plurality of sound information with the presentation 
position changed, or the status of sequentially presenting the plurality of 
sound information. 

By selecting the status of presenting sound information 

10 simultaneously or sequentially, the sound information can be presented, not 
in an inflexible manner, but in a more appropriate manner suiting the 
situation when the information is to be presented as audio output. 

Further preferably, the information presentation apparatus includes 
an arrangement unit time-controlling independently the position of sound 

15 information for arrangement in presenting the plurality of sound 

information at the same time with the presentation position changed. The 
position of each sound is arranged on the circumference of substantially a 
circle to move in an orbit. The rotation condition and sound placement 
condition are set according to the property of the sound information to be 

20 presented. 

By arranging the sound information on the circumference of a circle 
to move in an orbit with the user present at a certain contact point of that 
circle, the user himselfTherself can easily recognize the mutual position 
relationship of the sound such as the most closest sound information 

25 position, the farthest sound position information, and the like in presenting 
a plurality of sound information at the same time. By setting the rotation 
condition such as the rotation speed or rotation radius, and the sound 
placement condition such as the distance between sounds, an information 
presentation environment suiting each user can be established. 

30 The circle on which the sound information is to be arranged does not 

have to be a complete circle. Depending on the number of sound 
information presented at the same time or the user's preference, sound 
information can be presented with the portion of the circumference of the 
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circle that is most remote from the user cut. 

Further preferably, the information presentation apparatus includes 
an arrangement unit time-controlling independently the position of sound 
information in presenting a plurality of sound information with the 
5 presentation position altered. The position of each sound is modified to the 
position specified by the user independent of rotation of the position of the 
sound information. 

By the provision of means for modifying the position of each sound to 
a position specified by the user independent of the rotation, i.e., without 
rj 10 waiting for the orbital motion, sound information associated with the 
;5 desired information can be obtained immediately within the reach of the 

pi user, i.e., obtained at one step without having to depress the "rewind", 

s P "forwarding" buttons several times. 

71 Various information selection is allowed according to the 

IB 15 information presentation apparatus such as directly calling up another 
L sound from a slight position change of all the sounds being presented. 

m According to yet another aspect of the present invention, an 

fl information presentation apparatus groups, when there is difference in the 

q property between each sound information retained by the information, the 

O 20 property of each sound information prior to presenting the sound 
information. 

By grouping the property of each sound information and presenting 
the normalization as sound information after monauralizing the stereo 
audio in advance when stereo audio and monaural audio are mixed in the 
25 sound information in the case where there is difference in the volume level 
of the sound information, the user can recognize the placement position of 
the sound information for all sound information. 

Preferably, the information includes presentation information other 
than the sound information in the information presentation apparatus. 
30 The presentation information other than the sound information can be 
displayed together in displaying each sound information. 

By presenting together presentation information other than sound 
information such as image information or information by touch, the user can 
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obtain more easily the desired information. 

. Further preferably, the information presentation method presenting 
a plurality of information as at least sound information includes the step of 
modifying, in presenting sound information, the presentation status 
5 according to the property of the sound information to be presented. 

According to yet a still further object of the present invention, a 
computer readable recording medium is provided in which a program is 
recorded to cause a computer to execute the step of presenting a plurality of 
information as sound information, and the step of modifying the 
10 presentation status of the sound information to be presented according to 
the property thereof. 

The foregoing and other objects, features, aspects and advantages of 
the present invention will become more apparent from the following detailed 
description of the present invention when taken in conjunction with the 
1 5 accomp anying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is an operation image diagram according to a first embodiment 
of the present invention. 

Fig. 2 is a control flow chart describing the operation of the first 
20 embodiment. 

Fig. 3 is an operation image diagram according to a second 
embodiment of the present invention. 

Fig. 4 is a flow chart to describe the operation of the second 
embodiment. 

25 Figs. 5A-5C are operation image diagrams of details of the first 

embodiment. 

Figs. 6A-6C are operation image diagrams of menu hierarchy. 
Fig. 7 is a diagram of a structure of an audio selection apparatus. 
Fig. 8 is a block diagram of an audio information selection apparatus 
30 according to a third embodiment of the present invention. 

Fig. 9 is an operation image diagram of the third embodiment. 
Fig. 10 is a control flow chart describing the basic operation of the 
third embodiment. 
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Fig. 11 is a control flow chart showing the modifying manner of the 
presented information when the present invention is applied to a mail 
application. 

Fig. 12 is a control flow diagram showing the modifying manner of 
5 the presented information when the present invention is applied to music 
CD retrieval. 

Fig. 13 is an operation image diagram according to a sixth 
embodiment of the present invention. 

Fig. 14 shows the change in display when an image is used together 
10 in the sixth embodiment. 

Fig. 15 is a block diagram of an audio information selection 
apparatus according to the sixth embodiment. 

Fig. 16 is a diagram showing a structure of an apparatus according 
to a seventh embodiment of the present invention. 
15 Fig. 17 is a flow chart describing switching of the information 

presentation status according to the information presentation apparatus of 
the seventh embodiment. 

Fig. 18 is an operation image diagram of a method 1 of the seventh 
embodiment. 

20 Fig. 19 is a control flow chart showing the basic operation of method 

1 of the seventh embodiment. 

Fig. 20 is an operation image diagram of a method 2 of the seventh 
embodiment. 

Fig. 2 1 is an operation image diagram of a format in which an image 
25 is employed together in method 1 according to an eighth embodiment of the 
present invention. 

Fig. 22 is an operation image diagram of a format in which an image 
is employed together in method 2 of the eighth embodiment. 

Fig. 23 is a diagram showing a structure of an apparatus realizing 
30 the eighth embodiment of the present invention. 

Fig. 24 schematically shows another controller according to an 
information presentation apparatus of the present embodiment. 
DESCRIPTION OF THE PREFERRED EMBODIMENTS 
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Embodiments of the present invention will be described hereinafter 
with reference to the drawings. 
First Embodiment 

Referring to Fig. 1, a user 1 listens to a plurality of sounds controlled 
by a control device 3 through a headphone device 2. A controller including 
a rewind button 4, a select button 5, and a fast-forward button 6 is provided 
in control device 3. Control device 3 carries out the operation to realize the 
left and right volume adjustment of headphone device 2 or a stereo speaker 
so as to allow user 1 to recognize sounds P1-P2N located on a horizontal 
plane in the front direction of user 1, and provides control to effect 
simultaneous play as if the plurality of sounds PI -P2N at a constant interval 
move in an orbit. In controlling the rotation of the orbit, the volume is 
altered according to the rotation so that the volume of a certain sound P is 
set to the maximum when at a point A closest to the user and to the lowest 
volume when at a point B farthest from the user. The volume is repeatedly 
increased and lowered gradually to attain the largest volume at point A and 
the lowest volume at point B. The relationship of the volume of each sound 
in Fig. lis established as Pi >P2> ■ • ->PN>PN+1<- • -<P2N 3 P2N< 
PI. This process corresponds the steps up to S 121 in Fig. 2. 

Fig. 2 is a control flow chart describing the operation of the first 
embodiment. A sports program guidance of a multichannel broadcast will 
be taken as an example with reference to Figs. 1 and 2. Music or sound 
corresponding to each sport such as the theme song of a professional 
wrestler for a professional wrestling match program, the beat of a drum 
issued at the start of the sumo tournament for a sumo broadcast are 
prepared to move in an orbit as sound. Also, the sound may be the audio 
output per se of each broadcast. Here, it is assumed that sound Pi 
corresponds to the theme song of a professional wrestler, P2 corresponds to 
the drumbeat for sumo, PN+1 corresponds to the sound of a tennis ball 
hitting a racket, and P2N corresponds to the song for supporters of a 
baseball team. 

At step S12 ? sounds differing in volume move in an orbit as described 
above. At step S13, the depression of select button 5 at the status of Fig. 1 
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when the user decides to select a professional wrestling match program at 
the maximum volume causes a process to be carried out in which the 
professional wrestling match is handled as the desired information (S13, 
S16, and S 17 in Fig. 2). When another sport is to be selected at the status 
5 of Fig. 1, the user waits until the desired program is heard at the largest 
volume or returns the position of each sound to one previous step using 
fast-forward button 6 or rewind button 4 to obtain the greatest audible 
output of the program that is to be selected (S14). Then, the position of 
each sound is advanced by one step (S15). Next, select button 5 is 
, n 10 depressed. When a baseball game program, for example, is to be selected at 
43 the status of Fig. 1, the user waits a little or depresses fast-forward button 6. 

When the sumo program is to be selected, the user either waits for a rather 
long time or depresses rewind button 4 or fast-forward button 6 for the 
^ adjustment. Alternatively, selection switches corresponding to respective 

y£ 15 positions of each sound can be provided so that the user can depress an 
* appropriate selection switch corresponding to the sound that is to be selected. 

m In this case, the desired sound can be directly selected. 

M- Referring to step S12 of Fig. 2 again, only a predetermined number 

2ij of programs can be extracted to move in an orbit for selection when there are 

o 20 so many programs that it is difficult for a simultaneous orbital motion of all 
the programs such as in the case of a movie broadcast guidance of a 
multichannel broadcast. By replacing at a point B most remote from the 
user the sound that has not been selected over a predetermined period with 
information that is not yet included in the orbit, one information can be 
25 selected from a great many selection branches (S122, S123 in Fig. 2). In 
this case, a notify sound that does not disturb the information audit output 
is sounded in order to indicate that the information has been revised. This 
method will be described with reference to Figs. 5A-5C. When the tennis 
program has not been selected over a predetermined time in the above- 
30 described sports program guidance (refer to Fig. 5A), the sound at the head 
of the sound queue Q (for example, the sound of a golf program) is extracted 
from queue Q to move in the orbit instead of the tennis program. The 
sound of the tennis program is set back to the end of queue Q (Fig. 5B). At 
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the time when the sound of the golf program attains the maximum volume 
for the first time, the notify sound is issued together to indicate that is a new 
program on the orbit(Fig. 5C). 
Second Embodiment 

5 A second embodiment of the present invention will be described with 

reference to Figs. 3 and 4. In the present second embodiment, an image is 
employed in addition to the sound for the purpose of information selection. 
A controller including a rewind button 4, a select button 5, a fast-forward 
button 6, a cross pad 7, and a display device 8 is provided in a control device 

10 31. User 1 views a plurality of images and hears sound under control of 

control device 31 through headphone device 2 and display device 8. Control 
device 31 provides control to move images D1-D2N in an orbit corresponding 
to sounds P1-P2N, respectively, orbiting at a constant interval in 
synchronization with the sound using display device 8 to display the image 

15 information (S321 in Fig. 4). Correspondence between the volume and an 
image is established so that the image is displayed with the largest area 
when at the maximum volume. Thereafter, the volume is gradually 
lowered to attain the lowest level of volume. Corresponding to this change 
in the volume, the area of the corresponding image becomes gradually 

20 smaller than the largest area to eventually attain the smallest area. Then, 
the volume and the area gradually become larger to attain the largest 
volume and area. 

In the case where the user is to select information, the user operates 
a pointer F on display device 8 using a pointing device such as a cross pad 7, 

25 for example, to directly select an image on display device 8. Alternatively, 
when that user wishes to select another sports program under the status of 
Fig. 3, the user waits until the desired image is exactly in front and the 
sound is heard at the largest volume. Instead of waiting, the user can 
return(S34) or advance(S35) the position of each image and sound by one 

30 step to let the desired information to be located in front and hear the sound 
at the largest volume using fast-forward button 6 or rewind button 4. Then, 
select button 5 or cross pad 7 is depressed. In response, the information 
associated with the sound designated by cross pad 7 is determined as "the 
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desired information" (S36). For example, when a baseball program is to be 
selected under the state of Fig. 3, the user waits for a short time or depresses 
fast-forward button 6. When a sumo program is to be selected, the user 
waits for a longer period of time or depresses rewind button 4 or fast-forward 
5 button 6 for adjustment. 

Referring to step S32 of Fig. 4 again, only a predetermined number 
of programs can be extracted to move in an orbit for selection when there are 
so many programs that it is difficult for a simultaneous orbital motion of all 
the programs such as in the case of a movie broadcast guidance of a 

10 multichannel broadcast. By replacing the sound that has not been selected 
over a predetermined period with information that is not yet included in the 
orbit at a point B most remote from the user, one information can be selected 
from a great many selection branches (S322, S323). 

When categorization is possible in the case where there are many 

15 selection menus, an index of the categories is produced by the sound 

corresponding to a read out of the label of each index. By selecting that 
sound, the contents of a relevant category can be made to move in an orbit as 
a certain sound. 

Control device 31 may be a personal computer. A drive device 40 of 
20 a recording medium 41 is provided at personal computer 31. A program to 
cause the personal computer to carry out an operation according to the 
control flow shown in Fig. 4 is recorded in recording medium 41. This 
applies also to the other embodiments described hereinafter. 

Figs. 6A-6C are operation image diagrams of specific examples. 
25 Referring to Fig. 6A, it is assumed that a sound indicating the category of 

sports is selected from the menu of sports, movies, music, and drama. Upon 
selecting that sound, the contents of the relevant category, i.e., the sounds of 
a baseball program, professional wrestling program, tennis program, sumo 
program and the Eke are moved in an orbit. Upon selecting the sound 
30 indicating a baseball program in Fig. 6B, the sound of a baseball match such 
as Giants versus Tigers, Dragons versus Swallows, Baystars versus Carp's, 
Lions versus Buffaloes corresponding to the lower hierarchy of the category 
move in an orbit(Fig. 6C). 
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Following the above description of the method of the first and second 
embodiments, an apparatus realizing the present invention will be 
described hereinafter with reference to Fig. 7. Referring to Fig. 7, a sound 
information selection apparatus 100 includes a display 8, a headphone 2, a 
5 hard disk 13, a memory 14, a CPU (central processing unit) 15, and a 

controller 16 with a cross pad, a select button, a fast-forward button, and a 
rewind button. A program is supplied via a network or from hard disk 13 
in the form of a program medium to be stored in memory 14. CPU 15 reads 
the program on memory 14 to control the volume and rotation of a plurality 

10 of sounds and supplies the information to headphone 12. Also, a plurality 
of images corresponding to the plurality of sounds are adjusted in size and 
rotation to be supplied to display 11. Upon indication from controller 16, 
CPU 15 determines that the sound and image specified at controller 16 is 
the desired information of the user. 

15 Third Embodiment 

Fig. 8 is a block diagram showing the main part of an audio 
information selection system according to a third embodiment of the present 
invention. The audio information selection system includes a control 
device 32, an external information presentation device 82 directed to audio 

20 presentation, an external information presentation device 83 directed to 
presentation other than audio information, and a presentation indication 
device 84. Control device 32 includes an audio storage unit 811, a main 
control unit 812, a menu control unit 813, an audio conversion unit 814, a 
play control unit 8 15 and an information storage unit 8 16. External 

25 information presentation device 82 includes a headphone, a speaker, and 
the like for audio presentation. External information display device 83 
includes a display or the like for presentation of information other than 
audio information. Presentation indication device 84 includes a select 
button, a cross pad, a jog dial, a shuttle ring, a mouse, or the like. In Fig. 8, 

30 control device 32 is connected to external information display devices 82, 83 
and presentation indication device 84 with one machine by means of a cable. 
The present invention is not limited to such a connection, and mutual 
connection can be established through cable, network, or radio (wave, IK,, 
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and the like) communication. 

According to the information stored in information storage unit 814, 
main control unit 812 commands play control unit 815 to play the audio 
information stored in audio storage unit 811 or to play the audio which is the 
5 contents of information storage unit 8 14 converted by audio conversion unit 
812. 

When there is an input from presentation indication device 84, or 
when there is a command from main control unit 812, play control unit 815 
is directed to switch the presentation information according to menu control 

10 unit 8 13 for playback. 

The operation of the third embodiment will be described hereinafter 
with reference to Fig. 9. 

User 1 listens to the audio information sequentially presented by 
control device 32 through headphone device 2. This differs from the 

15 operation of the previous first and second embodiments. Control device 32 
includes a controller with a rewind button 4, a select button 5, and a forward 
button 6. Control device 32 sequentially switches the audio information 
corresponding to a plurality of information sources. More specifically, 
when there is a total of S information P to be presented, information P is 

20 sorted from PI to PS. Control device 32 sequentially switches the 

information for presentation such as presenting information P2 following 
the presentation of PI, presenting information P3 following the presentation 
of P2, ... . 

The sorting sequence (arranged order) of the information presented 
25 to the user may reflect the user's preference corresponding to a preceding 
selection. 

Fig. 10 is a control flow chart describing the operation of the third 
embodiment. An example is taken when the Nth information PN is 
presented. Upon activation of the system, presentation is initiated from 
30 the first information in the order of all the sorted information to be 

presented (S201). When a button is not depressed during presentation of 
information PN, information PN+1 is set as the next information to be 
presented (S205). When N+l exceeds S, i.e., when presentation up to the 



- 17- 



Sth information has been effected, the first information is presented 
again(S207). When a button is depressed during presentation of PN, 
presentation of PN is suppressed immediately (S208). When the depressed 
button is the rewind button, the next information to be presented is 
5 information PN-1 (S2 1 1). When N-l is 0, i.e., when N is 1, the Sth 

information is to be presented next (S2 14). When the depressed button is 
the forward button, the next information to be presented is PN+ 1 (S210). 
In the case N+l exceeds S, the aforementioned operation is carried out 
(S207). When the depressed button is the select button, determination is 
10 made that information PN is the information desired by the user (S2 13). 
Fourth Embodiment 

Fig. 11 corresponding to a fourth embodiment of the present 
invention shows the operation flow in a mail application. The method 
described with reference to Fig. 10 is repeatedly employed in this example. 

15 A mail application will be described hereinafter with reference to Figs. 9, 10 
and 11 as exemplary of the present invention. Upon initiating the 
application, notification is made of how many mails there are by voice (S301). 
A voice reading out information of the sender such as "OOth mail from OO 
(name) ... " and a message "END" that ends the application are prepared as 

20 the subsequent audio information to be presented. An appropriate audio 
information is sequentially presented (S302). When the user selects one 
mail according to the above-described selection means, the date, the name of 
the sender and label of the selected mail are read out (S303). Then, a 
message indicating the process with respect to that mail is presented as the 

25 audio information (S304). In a similar manner thereafter, the information 
that can be selected is automatically presented, and the user specifies a 
selection to proceed the operation using the aforementioned selection means. 
When it is not necessary to listen to the message from the beginning to the 
end in order to ascertain the contents of the information, forward button 6 is 

30 to be depressed during the presentation of the information. In response, 
the currently displayed information is skipped to facilitate presentation of 
the next information. In the case where the user cannot remember the 
contents of the information already output audibly, rewind button 4 can be 
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depressed to allow presentation of information that is already presented. 
For example, when the user fails the operation of recording a return mail 
and wishes to record again, presentation of other messages such as 
"Transmission is to proceed (S3081)" and "Transmission is canceled (S3082)" 
can be skipped by means of forward button 6 to obtain immediately the 
presentation of "Start recording over again (S3083)". Alternatively, the 
presentation order of the information can be followed in the opposite 
direction using rewind button 4 for presentation. 

By providing three operation buttons which are actually presented 
by voice and selecting appropriate audio information to proceed the 
operation, an interface that alleviates the confirmation task of the operation 
buttons and that can be specified audibly is realized. 

By dividing the information presentation into four stages, i.e., 
presentation of a plurality of mails (S302) and a menu of operations for the 
selected mail (S304, 3306, S308), the required information can be presented 
to the user corresponding to each situation. Selection of the mail per se and 
the operation with respect to the selected mail can be effected according to 
the same method and same buttons. 

The operation of the memory will be described with reference to Figs. 
8 and 11 hereinafter. 

According to the contents of information storage unit 816, main 
control unit 812 provides control to enter the number of mails in the 
appropriate portion of the information "A new mail has arrived. There are 
now OO new mails." (S301) The information is converted into an audio 
message at audio conversion unit 812, and play control unit 815 is 
commanded to play the converted audio message. Then, information of a 
fist of the senders of the received mails stored in information storage unit 
816 and that are now converted to the voice of "OOth mail, from OO" 
through audio conversion unit 812 (S3021-S3023), and also the message of 
"End" stored in audio storage unit 811 (S3024) are stored in information 
storage unit 8 16 as the mail selection menu. 

Menu control unit 813 directs play control unit 815 to play in order 
each information in the stored audio menu S302. 
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In the case where user 85 depresses the select button in presentation 
indication device 84 during playback of the voice reading out the name of the 
mail sender (S3021-S3023), main control unit 812 makes an inquiry to 
information storage unit 816 as to the label information corresponding to the 
5 mail that was currently displayed when the user depressed the button. 

The relevant information is converted into a voice message indicating the 
number, sender name, and title label of the selected mail such as "Oth mail 
from OO regarding OO n (S303) via audio conversion unit 812. The 
converted audio information is stored in information storage unit 816 and 

10 played by representation control unit 8 15. 

Then, the voice information reading out the operation that can be 
carried out with respect to the selected mail such as "Read out (S3041)", 
"The next mail will be read out (S3042)" is provided from audio storage unit 
811, and stored in information storage unit 8 16 as the function menu (S304). 

15 Menu control unit 813 directs play control unit 815 to play in each 
sequential order the operations in function menu (S304) stored in 
information storage unit 816. 

In a similar manner thereafter, the voice menu is read into 
information storage unit 816 according to the instruction of user 85, and 

20 audio presentation is directed by menu control unit 8 13. 

The fixed messages of S3024, S304, S305, S306, S307 and S308 in 
Fig. 11 are already stored in audio storage unit 811 as audio messages. In 
the case of presentation, the audio message is directly read into information 
storage unit 816 and played by play control unit 815. 

25 In contrast, the messages of S30 1, S302 1-S3023 and S303 differ 

according to the contents of the mail. The mail contents stored in 
information storage unit 815 are converted into appropriate speech via 
audio conversion unit 814. The converted audio information is stored in 
information storage unit 815 and played by play control unit 815. 

30 Here, audio conversion unit 814 applies voice synthesization on the 

text since mail is handled in the present embodiment. Not only voice 
synthesization, but audio other than the human voice can be handled 
depending upon the information of interest. 
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The present invention is not limited to a mail application, and is also 
applicable to the program guidance and the like of music CDs and 
multichannel broadcasting. 

Fifth Embodiment 

5 Fig. 12 shows the invention of the third embodiment applied to a 

music CD retrieval system as the fifth embodiment. Upon initiating the 
system, a voice reading out the genre is presented as information (S401). 
Upon selecting Japanese music therefrom, a genre of a more detailed level of 
Japanese music is presented (S402). In a similar manner thereafter, the 

10 operation of selecting an index of a category is repeated to select the desired 
information. It is to be noted that the information at S402 and S405 in Fig. 
4 are not the voice synthesization of the index in the category. The audio 
output of a CD can be used as an index since a keypart of the music in the 
CD can provide the identification of the contents of that information. Thus, 

15 when there are many information that is the target of search, the 

information can be categorized to provide an index to the user. Accordingly, 
the desired information is presented to the user. As to the operation of 
returning to the former operation (return to the hierarchy of one higher 
level), a button for the function of returning to one previous step can be 

20 added to rewind button 4, select button 5 and forward button in Fig. 9. In 
the case where return to one previous hierarchy is allowed, the audio 
information of "Return to one previous menu" is presented together with the 
information to be presented. The user can return to the previous hierarchy 
by selecting that information. 

25 According to the example of Fig. 12, desired music information can 

be obtained by dividing the indexes into seven stages of S401, S402, S403, 
S405, S406 and S407 of the menu that can be selected. Also, by adding the 
message of "Return to one previous menu" in the index information of the 
seven stages, the information itself can be handled at a level identical to 

30 that of the system operation command. 

One or a plurality of the "Return to one previous menu" message can 
be prepared in a series of indexes. When there is a great number of indexes, 
this message can be prepared at a constant interval. 
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In the case where the present invention is applied to the program 
guidance of a multichannel broadcast, indexes such as for each genre, target 
age and the like can be prepared in addition to the indexes for each channel 
and time to facilitate the user's selection of a desired program. The index 
label may be presented in the form of a synthesized speech, or in the form of 
the exact audible output of the program. 

When a list of the programs that is currently being broadcasted is to 
be presented according to the method of the present invention, presentation 
can be provided in a fashion switching the channel for every predetermined 
time. Alternatively, an audio output characteristic of respective programs 
can be presented as the program information. In this case where the 
program of a certain channel changes to another program of that same 
channel over time, the audio output of the new program is sequentially 
presented corresponding thereto. 

Sixth Embodiment 

The sixth embodiment is directed to presenting information visually 
and audibly using visual information in addition to the auditory information. 
The sixth embodiment employing visual information in a supplementary 
manner will be described hereinafter with reference to Figs. 13 and 14. 

Referring to Fig. 13, user 1 listens to audio information sequentially 
presented by a control device 33 via headphone device 2. At the same time, 
control device 33 provides to a display device 81 image information 
associated with the presented audio information. A list of all the images 
for the entire information to be presented is displayed at display device 81. 
The display is devised so that the image information corresponding to the 
information that is currently presented by audio can be identified at a 
glance by framing the image information with a bold line or the like. 

Fig. 14 shows the change in the screen of display device 81 when the 
presented information is switched. Control device 33 is implemented so 
that the audio information corresponding to a plurality of information 
sources are presented in a sequentially switched manner, and that the 
corresponding image information displayed on display device 81 visually 
attracts attention every time the presented audio is switched. One 



- 22- 



embodiment is shown in Fig. 14, wherein the image information 
corresponding to the information associated with the information currently 
presented by audio is enclosed by a bold line. Information G is presented 
by audio under the status of S61. Here, when there is no specification from 
5 the user, or when presentation of the next information is directed by the 
user by the depression of forward button 6, control device 33 presents 
information H, and the bold frame is shifted to surround H (S62). In the 
case where the user depresses the downward key of the cross pad under the 
status of S61, control device 33 determines that the user has specified 

10 presentation of information K displayed below G on display device 81. The 
audio presentation of G is suppressed and the audio presentation of K is 
initiated. At the same time, the bold frame is shifted to surround K (S63). 

Information other than the information that is currently presented 
by audio can be viewed by employing the image information as described 

15 above. Also, information that cannot be specified for presentation by just 
one depression of rewind button 4 and forward button 6 can be specified 
using the cross pad. The cross pad used as the pointing device may be a 
shuttle ring, a jog dial, a mouse, a joy stick or the like. 

Following the description of the method of the present invention, an 

20 audio information selection apparatus according to the third to sixth 
embodiments will be described hereinafter with reference to Fig. 15. 

An audio information selection apparatus 200 of the third to sixth 
embodiments includes a headphone 72, a hard disk 73, a memory 74, a CPU 
75, and a controller 76 with a cross pad, a select button, a forward button, a 

25 rewind button, and a button to return to the previous hierarchy. A 

program is supplied via a network or from hard disk 73 in the form of a 
program medium to be stored in memory 74. CPU 75 reads out the 
program on memory 74 and supplies the information to headphone 72. 
Also, control is provided to emphasize the image of the information that is 

30 currently presented corresponding to the presented audio output. Upon an 
instruction from controller 76, CPU 75 determines that the information 
according to the audio information that was supplied to headphone 72 at the 
time controller 76 was depressed is the desired information of the user. 
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The present invention is applicable to a wide range as the technique 
of selecting a desired one out from a menu of a plurality of information in 
addition to the above-described mail application, CD categorizing, and 
multichannel broadcasting applications corresponding to the third to fifth 
5 embodiments. 

Seventh Embodiment 

The seventh embodiment of the present invention is basically 
similar to the first to third embodiments. The method of presenting the 
plurality of information as sound information differs from the previous- 
ly described embodiments. The block diagram and the system diagram of the 
audio information selection apparatus are basically similar to Figs. 1 and 8, - 
respectively. The system of the seventh embodiment includes an audio 
storage unit 111, a main control unit 112, a menu control unit 113, an audio 
conversion unit 114, a play control unit 115, and an information storage unit 
15 116. 

Fig. 16 is a block diagram showing the main part of an audio 
information selection apparatus 300 of the seventh embodiment. Referring 
to Fig. 16, audio information selection apparatus 300 differs from the 
apparatus of the third embodiment in that control device 11 includes the 

20 method of controlling the volume and placement position independently 
while placing a plurality of information as sound information for 
simultaneous playing (method 1) and the method of presenting the audio 
information in a sequentially switching manner (method 2). According to 
the information stored in information storage unit 816, a play control unit 

25 815 is directed to play the audio information stored in audio storage unit 811 
or to play the audio information which is the contents of information storage 
unit 816 converted by audio conversion unit 814 by appropriately switching 
between method 1 and method 2. 

The flow of directing the switching of the presentation method will 

30 be described with reference to Fig. 17. Upon activation of the system in 
response to an instruction from the user (S1201), a series of audio 
information to be presented is read into the system. Detection is made 
whether there is audio information longer than the threshold value in the 
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series of information to be presented (S1202). When there is a longer audio 
information, method 1 (simultaneous playing of sound information) is 
employed (S1203). Otherwise, method 2 (played in a presentation 
sequentially switched) is employed (S1204). 

The threshold value may be a consistent value of the system, or a 
value set for each user according to the operation history of each user. 

A step of normalizing the volume or stereo/monaural audio prior to 
initiating presentation can be carried out(Sl205), The system executes the 
process automatically up to S1205, and then initiates presentation(S1206). 
A switching specification from the user (switching between the methods 
(S1207, S1208), and specifying/canceling normalization of audio parameters 
(S1209, S1212)) is always acceptable after initiation of the presentation and 
until the end of the presentation (S1210). 

Method 1 will be described with reference to Fig. 18 schematically 
showing the operation method and the flow chart of Fig. 19. User 1 listens 
to a plurality of sounds controlled by a control device 11 through a 
headphone device 2. A controller including a rewind button 4, a select 
button 5, and a fast-forward button 6 is provided in control device 11. 

Control device 11 carries out the operation to realize the left and 
right volume adjustment of headphone device 2 or a stereo speaker so as to 
allow user 1 to recognize sounds P1-P2N located on a horizontal plane in the 
front direction of user 1, and provides control to effect simultaneous play as 
if the plurality of sounds P1-P2N at a constant interval move in an orbit. 
In controlling the rotation of the orbit, the volume is altered according to the 
rotation so that the volume of a certain sound P is set to the maximum when 
at a point A closest to the user and to the lowest volume when at a point B 
farthest from the user. The volume is repeatedly increased and lowered 
gradually to attain the largest volume at point A and the lowest volume at 
point B. The relationship of the volume of each sound in Fig. 18 is 
established as PI > P2 > • • * > PN > PN+1 < • • • < P2N, P2N < PI. This 
process corresponds the steps up to S7321 in Fig. 19. 

Only a predetermined number of programs can be extracted to move 
in an orbit for selection when there are so many programs that it is difficult 
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for a simultaneous orbital motion of all the programs such as in the case of a 
movie broadcast guidance of a multichannel broadcast. By replacing the 
sound that has not been selected over a predetermined period with 
information that is not yet included in the orbit at a point B most remote 
5 from the user, one information can be selected from a great many selection 
branches (S7322, S7323 in Fig. 19). In this case, a notify sound that does 
not disturb the information audit output can sounded in order to indicate 
that the information has been revised. 

In the case where the position of the sound is to be slightly advanced 

10 or returned, fast-forward button 6 or rewind button 4 is shortly depressed, 
respectively, in order to control the rotation of the sound. Fast-forward 
button 6 or rewind button 4 is to be depressed for a rather long time when 
another sound is to be drawn close. The manner of button depression is not 
limited to this example. The position change of the sound is controlled in 

15 method 1 in response to the step indicating sound position change by the 
user (S733 and S734 in Fig. 19). Including the means for feedback in the 
button that directs position change can facilitate the perception of the user 
as to the moved distance of the sound position. Tactual sensation about the 
moved distance of the sound position by the user can be implemented by 

20 adjusting the resistance of the depression of the button. 

Presentation may be devised to facilitate the usability for the user 
by altering the parameters related to the sound placement and rotation such 
as the rotation speed, the rotation radius, the distance between sounds and 
the like according to the length and the like of the time of play of each sound 

25 for method 1. Also, a step or means for commnding the change of the 
parameters on the user side can be added. 

Method 2 will be described with reference to Fig. 20. Fig. 20 
corresponds to Fig. 9 of the third embodiment schematically showing the 
operation contents. User 1 sequentially listens to the audio information 

30 presented by control device 11 via headphone device 2. Control device 11 is 
provided with a controller including a rewind button 4, a select button 5 and 
a forward button 6. Control device 11 sequentially switches the audio 
information corresponding to a plurality of information sources for 
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presentation. For example, when there are a total of S information P to be 
presented, information P is sorted from PI to PS. Control device 3 
sequentially switches the information for presentation such as presenting 
information P2 following the presentation of PI, presenting information P3 
5 following the presentation of P2, 

The operation of method 2 is similar to that of the third embodiment. 
Therefore, description thereof will not be repeated. 

The sorting sequence of the information presented to the user 
(arranged order) can reflect the user's preference in selecting previous 

10 information in methods 1 and 2. When there is difference in the volume of 
each audio to be presented, normalization can be carried out prior to 
presentation to play all the audio at substantially the same volume level. 

It is needless to say that the sixth embodiment is applicable to the 
apparatuses for mails and CDs as in the fourth and fifth embodiments. 

15 An example of employing the seventh embodiment in processing 

mails will be described hereinafter. 

When it is not necessary to listen to the message from the beginning 
to the end in order to ascertain the contents of the information, depression of 
forward button 6 in Figs. 18 and 20 facilitates the call up of the previous 

20 sound when in method 1 and presentation of the next information skipping 
the currently presented information when in method 2. When the user 
does not remember the contents of a previous information and wishes to 
confirm again the contents, depression of rewind button 4 in Figs. 18 and 20 
allows the previously-presented information to be presented again. 

25 By employing method 1 in the case where the menu to be presented 

is long or when the information is to be obtained auditory while knowing the 
preceding and succeeding mails and by employing method 2 in the case 
where the menu to be presented is relatively short and each one is to be 
listened, information can be presented at the optimum status for the user 

30 regardless of the contents of presentation. Switching between the methods 
can be effected automatically by main control unit 112. Alternatively, a 
button for the user to specify switching can be provided so that main control 
unit 112 executes switching upon receiving the user f s instruction . 
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By providing a common interface including at least a select button 5 
with respect to methods 1 and 2 and additionally a rewind button 4 and 
fast-forward button 6, the user can obtain information with the same button 
and same operation even if the method is switched. 
5 The operation of the memory is similar to that of the third 

embodiment. Therefore, description thereof will not be repeated. 

The method of switching between method 1 and method 2 
appropriately corresponding to the seventh embodiment applied to a music 
CD retrieval system will be described hereinafter. The normal operation is 

10 identical to that of the third embodiment. 

Upon starting the system of the present application, a voice that 
reads out the genre as information is first presented. In the case of voice 
information by a guidance speech that can be presented in a relatively short 
time such as "Pops" and "Classic", determination is made that method 2 is 

15 appropriate. The audio information is sequentially switched and presented 
to the user according to method 2. In the case where music representative 
of each genre is employed as an index instead of the voice guidance, 
determination is made that method 1 is appropriate. The sound of each 
music is played and moved in an orbit using method 1 to be presented to the 

20 user. In the present example, main control unit 112 switches between 
method 1 and method 2 depending upon the property of the audio to be 
presented. Information is presented to the user according to either method 
1 or 2. A button that allows switching between method 1 and 2 according to 
the user's preference can be applied so that main control unit 112 switches 

25 between method 1 and 2 according to the user's instruction. 

By providing a common interface that includes at least 
determination button 5 for methods 1 and 2 and additional rewind button 4 
and fast-forward button 6, the user can obtain information with the same 
button and operation even if the method is switched. 

30 In the case where the present invention is applied to a program 

guidance of a multichannel broadcast, indexes such as for each genre, target 
age and the like can be prepared in addition to the indexes for each channel 
and time to facilitate the user's selection of a desired program. The index 
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. label may be presented in the form of a synthesized speech, or in the form of 
the exact audible output of the program. 

When a list of the programs that is currently being broadcasted is to 
be presented according to the method of the present invention, presentation 
5 can be provided in a fashion switching the channel for every predetermined 
time. Alternatively, an audio output characteristic of respective programs 
can be presented as the program information. In this case, when the 
program of a certain channel changes to another program of that same 
channel over time, the audio output of the new program is sequentially 

10 presented corresponding thereto. 

Here, main control unit 112 can implement determination 
automatically to switch between method 1 or 2 such as selecting method 1 
when the audio output of a program is to be directly output and method 2 
when a relatively short audio output such as an index is used. 

15 When presentation is effected using method 1 in the case where each 

audio to be presented is recorded at a different record level, there is a 
possibility of difference in volume which is one element for the user to 
recognize the sound placement position that "sound at a remote site is small 
whereas the sound at a close site is large" may be lost. Presentation can be 

20 presented without deteriorating the usability by normalizing the volume of 
each sound prior to presentation using method 1. By incorporating means 
to switch between method 1 and method 2, presentation can be provided 
switched to method 2 with the volume at the same level when the user 
decides to negate normalization of the volume level. It is also possible to 

25 provide presentation by method 1 without altering the volume level even if 
the audibility is slightly difficult. Thus, a user-friendly presentation 
means can be selected by the user corresponding to various cases. 

In the case where there is audio that includes a spatial wide sense 
such as recording at a concert in the audio to be presented, it may be 

30 difficult for the user to identify the location of the sound when presentation 
is carried out by method 1 using such audio. By converting such audio 
including this spatial wide sense into monaural audio prior to presentation 
using method 1, presentation can be provided without deteriorating the 
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usability. 

The present invention affords an application of presenting 
candidates of home pages disclosing information preferable for the user in 
the form of voice in browsing the home page on WWW. More specifically, 
5 the home page can be presented in voice form by an appropriate method 
such as voice-synthesizing the text information on the home page, 
employing the music information attached to the home page, converting the 
color information of the home page into sound and the like. 

By converting the information that is to be presented as a candidate 

10 to the user into audio by an appropriate method, information can be 

presented to the user by method 1 or 2 according to the property (playback 
time or the like) of the voiced information as audio. The user can browse 
any type of a plurality of information. 
Eighth Embodiment 

15 The eighth embodiment of the present invention presents 

information to the user both visually and audibly using visual information 
in a supplementary manner in addition to the auditory information of the 
seventh embodiment. The eighth embodiment employing visual 
information in a supplementary manner will be described with reference to 

20 Figs. 21 and 22. 

Fig. 21 is a schematic diagram showing the operation contents when 
visual information is employed for method 1. A controller including a 
rewind button 4, a select button 5, a fast-forward button 6, a cross pad 7, 
and a display device 87 is provided in a control device 12. User 1 views a 

25 plurality of images and listens to the sound under control of control device 
12 via headphone device 2 and display device 87. Control device 12 provides 
control to move images D1-D2N in an orbit corresponding to sounds P1-P2N, 
respectively, orbiting at a constant interval in synchronization with the 
sound using display device 8 to display the image information. 

30 Correspondence between the volume and an image is established so that the 
image is displayed with the largest area when at the maximum volume. 
Thereafter, the volume is gradually lowered to attain the lowest level of 
volume. Corresponding to this change in the volume, the area of the 
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corresponding image becomes gradually smaller than the largest area to 
attain the smallest area. Then, the volume and the area gradually become 
larger to attain the largest volume and area. Thus, identification is 
facilitated of which image corresponds to which sound and where the 
5 information is located. Here, the image to be presented may be a still 
image or a motion picture. 

In the case where the user is to select information, the user operates 
a pointer F on display device 8 using a pointing device such as a cross pad 7, 
for example, to directly select an image on display device 8. Alternatively, 

10 when that user wishes to select information located at a remote site, the 

user waits until the desired image is exactly in front and the sound is heard 
at the largest volume. Instead of waiting, the user can provide control to 
let the desired information to be located in front and hear the sound at the 
largest volume using fast-forward button 6 or rewind button 4. Then, 

15 select button 5 or cross pad 7 is depressed* 

Fig. 22 is an image of the case where visual information is employed 
for method 2. User 1 sequentially listens to audio information presented by 
control device 12 via headphone device 2, At the same time, control device 
12 provides to a display device 87 image information associated with the 

20 presented audio information. A list of all the images for the entire 

information to be presented is displayed at display device 87. The display 
is devised so that the image information corresponding to the information 
that is currently presented by audio can be identified at a glance by framing 
the image information with a bold line or the like. 

25 The change in the screen of display device 87 when the presented 

information is switched is identical to that described with reference to Fig. 
14. Therefore, description thereof will not be reapeated. 

An audio information selection apparatus 400 according to the 
seventh and eighth embodiments will be described hereinafter. 

30 Referring to Fig. 23, audio information selection apparatus 400 

includes a display device 87, a headphone 2, a hard disk 1103, a memory 
1104, a CPU 1105, and a controller 1106 including a cross pad, a select 
button, a forward button, a rewind button, a button to return to the previous 
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hierarchy. A program is supplied via network or from hard disk 1103 in 
the form of a program medium to be stored in memory 1104. CPU 1105 
reads the program on memory 1104 and supplies the read program to 
headphone 2. Control is provided to emphasize the image corresponding to 
the audio that is currently presented. The image is supplied to display 
device 87. Upon a command from controller 1106, CPU 1105 determines 
that the information corresponding to the audio information supplied to 
headphone 2 when controller 1106 is depressed is the information desired by 
the user. 

Fig. 24 is another example of controller 1106 provided in the 
information presentation apparatus of the seventh and eighth embodiments-. 
Controller 1106 includes any or all of a volume normalization/ cancel 
command button 21, a stereo • monaural switch button 22, and a 
presentation method switch command button 23 in addition to rewind 
button 4, select button 5, forward button 6 and cross pad 7 of controller 1106 
shown in Fig. 23. The user can command the information presentation 
status to be modified to effect normalization when the property of the audio 
information to be presented differs or to group the property of the audio 
information such as conversion into monaural output. 

The pointing device of the present invention may also have the 
function of repeating tactual sensation feedback according to the degree of 
the operation of the user. More specifically, tactual sensation feedback can 
be incorporated besides sound and visual recognition of the portion of 
information. For example, it may be generally difficult for the user to 
identify the location of sound even if image information is added to the audio 
information. The pointing device such as a track ball itself can be rotated 
slowly corresponding to the presentation status of the sound. By applying 
the tactual sensation feedback such as a smooth move when in the fast- 
forward operation and a move with slight resistance when in a rewind 
operation in moving the sound information, the user can recognize more 
properly the sound position. In the operation of drawing sound information 
near, the operability of the user side can be improved by applying some 
feedback such as the tactual sensation in the interface device of the pointing 
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device in synchronization with the rotation of the sound information. 

The present invention is not limited to the above-described 
embodiment. The present invention may be a computer-readable recording 
medium in which a program is recorded to cause a computer to operate as 
5 control device 3. For example, it may be any type of a recording medium 
such as a magnetic tape, a CD-ROM, an IC card, a RAM card or the like. 

In addition to the application to mail, CD categorization, 
multichannel broadcasting, and WWW browsing described in the present 
specification, the present invention is applicable to a wide range of field as 
10 the technique of selecting a desired one from a menu selecting one 
information from a plurality of information. 

Although the present invention has been described and illustrated in 
detail, it is clearly understood that the same is by way of illustration and 
example only and is not to be taken by way of limitation, the spirit and scope 
15 of the present invention being limited only by the terms of the appended 
claims. 
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WHAT IS CLAIMED IS: 



1. An information selection method selecting desired information 
from a plurality of information represented by sounds, comprising the steps 
of: 

time-controlling a position of each sound independently, and 
selecting a sound, 

wherein said step of selecting information includes the step of 
selecting information associated with sound. 

2. The information selection method according to claim 1, further 
comprising the step of controlling volume in association with the position of 
each sound. 

3. The information selection method according to claim 1, wherein 
said step of controlling the position of each sound independently includes the 
step of arranging the position of each said sound on a circumference of 
substantially a circle to move in an orbit. 

4. The information selection method according to claim 3, further 
comprising the steps of: 

commanding a position change of all of said sounds faster than a 

normal time control, and 

returning the sound to a former position. 

5. The information selection method according to claim 2, wherein 
said step of selecting information is a single operation of selecting a sound of 
the maximum volume. 

6. The information selection method according to claim 1, wherein 
said step of selecting information is an operation of directly selecting a 
sound of interest. 
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7. The information selection method according to claim 1, further 
comprising the step of displaying an image corresponding to each 
information at a position corresponding to said each sound. 

8. The information selection method according to claim 7, wherein 
said step of selecting information includes the step of selecting an image 
corresponding to said each sound. 

9. An information selection apparatus selecting desired 
information, and including a sound source, said information selection 
apparatus comprising: 

means for time -controlling a position of each sound independently, 

5 and 

means for selecting a sound, 

wherein said sound selection means selects information associated 
with said sound. 

10. A computer readable recording medium in which a program is 
recorded to cause a computer to operate means for time-controlling a 
position of each sound independently and means for selecting desired sound 
from a plurality of sounds. 

11. An information selection apparatus selecting a desired 
information source from a plurality of information sources, said information 
selection apparatus comprising: 

means for sequentially switching said plurality of information 
5 sources as audio information and presenting the audio information by said 
sound source, and 

means for selecting audio information relevant to a desired 
information source from the presented audio information. 

12. The information selection apparatus according to claim 11, 
further comprising means for commanding switching of said audio 
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information. 

13. The information selection apparatus according to claim 12, 
wherein said switching command means commands presentation of audio 
information presented after the audio information that is currently 
presented or presentation of audio information that is presented prior to the 
5 audio information that is currently presented. 

14* The information selection apparatus according to claim 11, 
wherein said information source retains information other than audio 
information and presents said other information when the desired audio 
information is selected. 

15. The information selection apparatus according to claim 11, 
wherein said information source retains information other than audio 
information, and sequentially switches and presents said other information 
in accordance with switching of said audio information. 

16. An information selection method selecting desired information 
source from a plurality of information sources, comprising: 

a first step of sequentially switching and presenting said plurality of 
information sources as audio information, and 
5 a second step of selecting audio information relevant to a desired 

information source from the presented audio information. 

17. The information selection method according to claim 16, 
wherein said plurality of information sources are categorized in advance 
into predetermined types, and further comprising the step of gradually 
narrowing down information out from categorized information sources by 

5 repeatedly employing said first and second steps. 

18. A computer readable recording medium in which a program is 
recorded to cause a computer to operate means for sequentially switching a 
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5 



plurality of information sources and presenting the audio information by 
sound source, and means for selecting information relevant to a desired 
information source from the presented audio information. 



19. An information presentation apparatus comprising: 

means for presenting a plurality of information as audio information, 

and 

means for modifying a presentation status of said presentation 
5 means according to a predetermined condition. 

20. The information presentation apparatus according to claim 19, 
wherein said predetermined condition is a property of said audio 
information presented. 

21. The information presentation apparatus according to claim 19, 
wherein said predetermined condition is specified by a user. 

22. The information presentation apparatus according to claim 19, 
wherein said modified presentation status includes one of a status of 
presenting simultaneously a plurality of sound information with the 
presentation position altered, and a status of sequentially presenting the 

5 plurality of sound information. 

23. The information presentation apparatus according to claim 22, 
comprising means for time-controlling independently and arranging a 
position of said sound information, 

when presenting said plurality of sound information simultaneously 
5 with the presentation position altered, 

wherein the position of each sound is arranged on a circumference of 
substantially a circle to move in an orbit, and a rotation condition and sound 
placement condition are specified according to a property of sound 
information to be presented. 
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24. The information presentation apparatus according to claim 22, 
comprising means for time -controlling independently and arranging a 
position of said audio information, 

when presenting said plurality of sound information simultaneously 
with the presentation position altered, 

wherein the position of each sound is modified to a position specified 
by a user independent of rotation. 

25. The information presentation apparatus according to claim 19, 
comprising means for grouping a property of each sound information prior to 
presentation of the sound information when there is difference in property - 
between each sound information retained by said information. 

26. The information presentation apparatus according to claim 19, 
wherein said information retains presentation information other than sound 
information, and comprising means for presenting the presentation 
information other than the sound information together with each sound 
information. 

27. An information presentation method comprising the steps of: 
presenting a plurality of information as audio information, and 
modifying a presentation status according to a property of said audio 

information to be presented. 

28. A computer usable recording medium in which is stored a 
command to cause a computer to execute the steps of: 

presenting a plurality of information as audio information, and 
modifying a presentation status according to a property of said audio 
information to be presented, 

when executed by the computer. 
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ABSTRACT OF THE DISCLOSURE 

An information presentation apparatus is provided presenting an 
interface suitable for selecting desired information from a plurality of 
information. The apparatus has three methods of presenting information. 
The first method is to present information by sequentially playing and 
presenting a plurality of audio information related to the information in 
turn. The second method is to present the plurality of audio information at 
the same time wherein each sound has its directivity. The third method is 
a combination of the first and second methods wherein user can select 
desired method between the two depending on kinds of information 
presented. 
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